This Page is Inserted by IFW Indexiiig aad ScamiEg 
Operations and is not part of the Official Record 

BEST AVAILABLE MAOM 

Defective images within this document are accurate repres^tiofli ef tiie ori^ 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BOKDEMS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES- ^ 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMrTTED ARE POOR QUALIT¥ 

□ OTHER: ^— — — 

IMAGES ARE BEST AVAILABLE COPYe 
As rescaming these documents will not correct tbe image 
problems checked, please do not report these profelems to 
the IFW Image Problem Mailbox. 



(19)H*H1*if/f (JP) 02) ^ H Jj^p ^ ^ (A) (ll)»fHH«^H«# 

1-55540 

(43)^ B ¥1^11^(1999)2^268 



(5i)inta' mmn fi 

H0 4N 1/60 H0 4N 1/40 D 

1/46 1/46 Z 



(21)tlUS#^ 






oomms 














(22)mHQ 


3Kd69^(1997)8^7B 














m #11 










*gGE8f!SKa*ilSHT a 19* 2 # 


B* 
















(72)5!i«# 












*S3SjfflSKgS38SlSHTai9»2^ 


B* 






























B4: 























(54) [9»qa>«»] ffilS!fft^^E;^«J:rmia«<}:tf::cD;^$£iiL;ft:eejKf|: 



(CT) 

5-Blft<?>fe^5r AHcoaiititIB LJte^fe:^ 



<' 




203 



I 



206 



I 





} ^204 







208 



-209 



(2) 



^m^l 1-55540 



a. mmmizitiJjwsnm^mmnzmtfiMmi^ 
m.T^m^tif::m^?^iz\iim^ff)9im^ms 



iJV^T. 20 

mmm(r>^mi)-i^. mm?:mmmtxm»tz^ 

msm-crmmmzif). ^mmz-m^tu^^ 
iz. ^mmmiziii:^imffm^^mi^fbt-fmmi^ 

mssm-cofmstmizx*). Axmmzm.^itf::^ 

iz^-ti,mmcoi!^mt . 30 
mi!g<7)>ra3^t i os^sti/wfe^tcitL-c. mm 

mm(D9mmizxhmm^. ^^<7)9mmizii 

mt^mzm^\>^x. msi<7)m^mz-»mthm:^cr, 

mA<r>wmmizxi^mmznu mmm^j^^j:\.^ 

m^cr>>i!mmizj:-yxni^tUim^^uznL. m^fj 
nkii^v^^^mizfiBtxm&uoum 0 ss* 4o 

¥(x.y)=0.299 ■ R(x,y)+0.587 
ZZX. R(x, y).G(x. y) HXl/B (x, 
y) fi. B^LhOffiM (x. y) llfcH-S^R (#) . 
G (ii) . B (#) ^*cOH^ttrj>'9. Y (x, y) 

[00041 

fe, IP*>. (R, G. B) <0ffl-&WM^r-5 



imms 1 y(iy-mmi:m^mmz^^h9m& 

amm-conmizx 0 . s/!SB«titiHa$ixfc^fc. 

^mmmiztii:f]m^mm^mtz)i5\:^ytnmu^ 

t:m^'Mx&mE.<mmk. 

mm^z.(r)^izi. *) . Axmsnz^^tifz^iz. 

izM^\.^x. m.<m^^iz^mt?>m^<mmt. 
m:^(09!mizi:i,-»mi&^izML^ mmm^^^\.^^ 

[0001 ] 

\.\ FAX^r'J>:J'^rt'<oaJ:»Jliligtc*7-B«S:» 

mmmz^mLxtii:}}-tm«mm^^Ujmtiir/mm 
iiXvzcr,:m^smLtzmmmzmth i><nTh 

[0002] 

Rim) .G m) . B (») <m^Tm,-t 
^ztm\>\ ^cr>^. wkconmmmmx 
( 1 ) izm^\,^x. Aij/ty-mm<^mmmi: 

[00031 



G(x,y) +0.114 ■B(x,y) (1) 

<<^5tv^pm)ij,-5:t. mz^ MmmLti:i(ty 
~coii:^mBi:iftsmmzis\,^x . ^am^skxh 
-s.»SB®«i*i^M^aitfc-r -I. t V ^ d i^is^^ t $ 

[0 00 51 FAx^i:\ mtmoimx-m. 



3 

[0006] m*Ofia|^H3<0 ( a ) t^-r. 03COA 
-(^a#?:J:j^fiO^ ( 1 ) lzm':S\.^X»mmr^'^L 

1 0 0 0 7 1 *i6BHii. ej«Mi!itov^T«. tnum 

xfflifetovi-ctt. mm^^omnomizmmm 
m^mmizf^tx. m^j:i>^mmm\mmk^ 

[0008] 

iz^i-&mm^m^m. iii:hwmmm^mBm 
txm^mtii:f}-tm^m^^^. AxHmtc 

[0009] 

[ooioiHifcfci^T. lommwmm^. lo 

2«iSai^*i^J«a5, 10 3«BfiK^a5. 10 4«fe 
?S^Sigi5. 1 0 5«fe??rat)^S'Ja5. 10 6{4»SB« 

[00111 ^(m&nxx/imm i e itxa 2 * 
miL^j:ii^mizmmti>. 
<mmw^^> : 1 0 1 

Bm#«SSl 0 1-C«. :^y-mm.. »SB«. fci 
tX. »SBIRS-f^(£-r'Sj^-C^$tLSB«?Jr#»t 

sm^i-^fts^iis 10 2 x'ii. m^mmu 101 woxr ^ 

t^i^Sr^toS (02«8c^^^Scoftsj«2O2i>J:If 
2 0 6#Bg) . Cd-CfflV^Sfewg^li^ RGBJ^XYZ 
^fc*<?5i&?^, vy-b;l/^C I ELUV. CIELAB 

• <^J:d^gm. xy^u' v' ^iftf02i}C7CWfee[ 

■ca^oTt,fili5=5rV>. Sifc^^f^jigaJl 0 2KJ:Sife* 
Bm^HB^10 3t,L<«. fe^^miOS^ 



3) !^M¥ll-55540 

4 

<BSl^Haa> : 1 0 3 

Hm^ISS 1 0 3T14. J^^^f^fegUl 0 2<7yl^mz 

tiMz^-rt (H2B««o3Mi2 0 3#flg) . -imt 
mmmi. mmmzmMmco^ihtpy^izMrf 
v^rffd. m*>. j^*ffi«oaAffi*s^BSK<o— ^ 

10 <feag^«ia!> : 104 

^^^su 1 0 4 -ca. Bm^)-aa5 103 iza^^xx 
xmrntz-i^m^timmznu rgb^jko^bs^ 
fit. m(ommmhmmL(miz^-i-i 
(a2f^ia<7^2 0 5#«3) . Aiatf^tt^tijtiBi- 

SttT^-r*. HVCSH. HSISS. HSV^ 
5:k'^. *3t. CIELUV-^C IELABOi3=3rl^ 

20 [00121 ^?5m3ftacoa«x-^'l4, B«IS«SI5 
1 0 l'^M^tif:im. ^^^H^&m 0 2tii3V^ 

<i^s^s'ia5> : 1 0 5 

^s^mm 1 0 /^m.izit)6-th^sij^ 
sm^^i^m^io2ffym^izm^\,^x. ^mjm 
^■mtiz^mti. m2^ss^m\2oiiikxmm 
^ffyyii\^u^^^m^2osw^) , fi^^iai^m 

30 [0013] <\> ^mfm^i^mm.^t^^^'Hb 

^^^<nmSi (Lth, Cth) t^^s. 

< 2 > ]^5i-fli<ofi±fi*«!aj u . iff)S[:km)iznm 

hm:^t-hVX.n^^t^^}^LW. Lth. Cth 

[00141 < 3 > itS!FF***^StOB*t*t LT. 1^ 
«fc <2> cOgffSrfiVK ^B*t:«tTi^iJ?Sroft 
SiktiO. fe^ia^M^rSISSifftto, Incogs 

40 ^■m^z^mth. 

[00151 <4 > 1 -^<7ym^mz^t,ixhmmwfi 

[00161 ^^^mir 0 5<?)te^±, WiSHfiS^ 

imim^u) : 106 

aSBfi^^SJ 1 0 6 X'\i. i^BffitJ itXAXHM^- 

50 K^fiiznLx. mmm^i^L^ m^iim^wm 



(4) 



1-55540 



1 0 (E2a*ffii»t»g[l^'<jl'«oSI0S 
T 2 0 4 fcit/gS^^^tWJSP^K^J 0 2 0 

[0017] mmmi^ 1 0 3 (cisi^T a^Hfiitc^ 

iD. WflS»i&^i-& (H2B*fi«t»ffiV<;P 
<i^J'}aT2 04^) , * 
Y' (i, j ) =scale - (Y ( i, 
scale = (Y2 -Yi ) / (Y.ai 

[ 0 0 2 0 ] . m-U^^mziriiii^lzjitL 

Y' (i, j ) =interval ■ Order (Index ( i 
interval = (Y2 -Yi )/(N-l) 

( i . j ) cOB^ffi3!)JJa-r&a5t}^^cOiSffl'J^. order 
(k) tt. |$SiJ^*5kT'*^SI!^J-^ISfc:i'J03T^>ix:t 

[0022] *||BH»i. ii^<o#fcH2 t:^Ly;:«ia<^ 

[0023] 

m^i^. x-nn'y-mm^im^tKm^tiizJim. 
mth i t i 0 i5^iss:aiiJcfl:L, ffi*iasi«iiB^ 

[0024] 03 (b) Ji. 03 (a) tP«<OA:^HA 



* [0018] , ( i , j ) {CiJttSRG 

Bmh<:0H*ffl^^ ( 1 ) liZLfzlfi-yXmrn.^^ 
( i . j ) ^^-f ^ . <J:tc. illS«^<Oft:*:fflY.« 
teit^ft/hffiY.in ^^46. aj:U«^IO^S^ 
{^^X\i. Yi iajiY2 OTt-rS) t*5tT»S<7) 

aj^fiv (i, j ) (2) \izLtiifi->xm>t. 

[0019] 



j ) -Y.in ) +Yl 

-Y.in ) (2) 

H{;«tT, ^^^^f^\m^%Xim^^i:XY<^ 
( 3 ) {c«-^>-^T»KP'^Kc3ESi^S. ^ ( 3 ) -e 

[0021] 

j ) ) +Yi 



(3) 



20 



30 



^m^j:hnmv'<~)v^m*)^xhti»y. n^(r)mw^ 

[02] i^^\,zk^mnmm.^ijjmmm<DWxi: 
[03] i^3ft<^e^«iigf 

101: HSi^aJ 
10 2: Sai^ffif^fiKSP 

10 3: H^iHsat 

104 :feS^«gP 

10 5: ^SmW^ 
10 6: fll^^l^^ 



[01] 



[H3] 



101 



□ 



■106 



-IG3 



(A) 



a) 



(5) 



1-55540 



^201 




C^" 



PAT -NO: 



JP411055540A 



DOCUMENT- IDENTIFIER : 



JP 11055540 A 



TITLE: 
IMAGE AND 



METHOD AND DEVICE FOR GENERATING LUMINANCE 



RECORDING MEDIUM RECORDING THIS METHOD 



PUBN-DATE : 



February 26, 1999 



INVENTOR- INFORMATION : 
NAME 

KAWAMURA, HARUMI 
AKIMOTO, TAKAAKI 
SUZUKI , SATOSHI 



AS S I GNE E - I NFORMAT I ON : 

NAME COUNTRY 
NIPPON TELEGR & TELEPH CORP <NTT> N/A 



APPL-NO: JP09212 753 

APPL-DATE: August 7, 1997 

INT-CL (IPC) : H04N001/60, H04N001/46 

ABSTRACT : 

PROBLEM TO BE SOLVED : To convert a natural image into a normal 
luminance 

image and to output a luminance image that makes the distinction of 
different 

color areas clear on an artificial image by providing an image 
classifying 

means which classifies color images into the natural image and the 

artificial 
image . 

SOLUTION: A frequency distribution generating part 102 
calculates the number 

of colors which have pixel values that are the same or close to a 
color image 

in an image accumulating part 101 in color space. An image 
classifying part 
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103 classifies the input color image into either a natural image or 

an 

artificial image based on a result of the part 102 . A color space 
transforming 

part 104 transforms each pixel value on RGB space to an image that 
is 

classified as the artificial image in the part 103 into a value on 
color space 

that corresponds to human perception. As for an image that is 
classified to 

the natural image in the part 103, a luminance image is generated 
by allocating 

a luminance level to each pixel value in accordance with the 
gradation 

reproductive range of an output device. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3 .In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the record medium which recorded the brightness 
image generation method which changes a color picture into a brightness image and outputs it to output 
equipment, such as FAX, a printer, etc. with few gradation expressions, equipment, and this approach. 
[0002] 

[Description of the Prior Art] Usually, a color picture expresses the color of each pixel in an image in 
the combination of R (red), G (green), and B (blue) in many cases. In that case, with conventional 
brightness image generation equipment, the brightness image was generated based on the formula (1) by 
changing each pixel value of an input color picture into the brightness component Y. 
[0003] 

Y(x y) =0.299, R(x y)-h0.587, G(x y)+0. 1 14, and B (x y) (1) Here, R (x y), G (x y), and B (x y) are 

the pixel values of each R [ in the coordinate on an image (x y) ] (red), G (green), and B (blue) 
component, and Y (x y) expresses the brightness component in the same coordinate. Moreover, "-" 
expresses a product. 
[0004] 

[Probleni(s) to be Solved by the Invention] In the brightness conversion based on a formula (1), since 
coincidence or the case of being mutually near arose [ a brightness component ] even if colors, i.e., the 
combination of (R, G, B), differ, there was a problem of being hard coming to distinguish the field of the 
different color on a brightness image. In an image including the alphabetic character and graphic form of 
the color which people drew especially, the problem of making difficult contents decipherment of the 
brightness image which it is as a result of [ the ] conversion is produced. In addition, about a natural 
image, the direction which changes according to a formula (1) can obtain a brightness image without 
sense of incongruity. 

[0005] Moreover, in case a color picture was changed into a brightness image and outputted to a device 
which expresses two or more gradation by two kinds of white and black, such as FAX, when there were 
few expressions of the gradation by binary than the number of gradation expressions of the brightness 
component Y of a color picture, there was also a problem that gradation of low brightness or a high 
brightness part could not fully express. 

[0006] The former example is shown in (a) of drawing 3 . The input image of drawing 3 indicates from 
the left the character string of the red the " Yokosuka R&D center" by superposition in the center blue 
from white on the right on the background from which a color changes gently-sloping. The result of 
having changed this image into the brightness image based on the above-mentioned formula (1) is 
drawing_3 (a), and since some brightness components of an alphabetic character and a background 
become the same, the example to which an alphabetic character becomes not clear is shown. 
[0007] About a natural image, this invention is gradation expression within the limits of output 
equipment, performs conversion in the usual brightness image, and aims at offering the record medium 
which recorded the approach of outputting the brightness image with which distinction of a color field 
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which is different about an artificial image according to the gradation expression range of output 
equipment in the case of conversion in a brightness image becomes clear, equipment, and this approach. 
[0008] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, in this 
invention, a color space division means to divide a color space into two or more subspaces is used to an 
image classification means to classify a color picture into a natural image and an artificial image, a 
brightness image generation means to output a brightness image according to the gradation expression 
range of output equipment, and the image classified into the artificial image. 
[0009] 

[Embodiment of the Invention] Hereafter, one example of the brightness image generation equipment 
concerning this invention is explained to a detail with reference to a drawing. 

[0010] For the frequency-distribution creation section and 103, as for the color space conversion section 
and 105, in drawing 1 , the image classification section and 104 are [ 101 / the image storage section and 
102 / the color space division section and 106 ] the brightness image generation sections. Moreover, 
drawing 2 is the flow chart having shown the flow of processing. 

[001 1] The configuration and function of each part are explained in order, referring to drav/ing 1 and 
drawing 2 . 

The <image storage section> In : 101 image- storage section 101, a color picture, a brightness image, and 
the image generated in the process which creates a brightness image are accumulated. 
The <frequency-distribution creation section> In : 102 fi:-equency-distribution creation section 102, it 
asks for the number of the colors which have a same or near pixel value in a color space from the color 
picture in the image storage section 101 (the creation 202 of the drawing 2 fi-equency distribution, and 
206 reference). The color space used here is the uniform color space corresponding to consciousness, 
and Y and L* of human beings, such as color spaces, such as RGB and XYZ, Munsell, and CIELUV, 
CIELAB. As long as two-dimensional chromaticity coordinates, such as a brightness shaft [ Uke ], xy, 
and uV, etc. are the space which evaluated the color, you may be what kind of space. The result 
depended on the frequency-distribution creation section 102 is transmitted to the image classification 
section 103 or the color space division section 105. 

The <image classification section> Based on the result of the frequency-distribution creation section 
102, an input color picture is classified into a natural image or an artificial image according to : 103 
image classification section 103 (classification 203 reference of the drawing 2 image). The judgment at 
the time of classifying is performed to the total number of pixels based on the rate that the maximum 
frequency occupies. That is, when the maximum of frequency distribution accounts more than for the 
fixed rate of the total number of pixels, consider as an artificial image and let except [ its ] be a natural 
image. 

The <color space conversion section> In : 104 color-space-conversion section 104, each pixel value on 
RGB space is changed into the value on the color space corresponding to human being's consciousness 
to the image classified into the artificial image in the image classification section 103 (conversion 205 
reference of the drawing 2 color space). In the color space corresponding to human being's 
consciousness, the HVC space which expresses a color by the three attributes of color of a hue, 
saturation (or saturation ratio), and lightness (or reinforcement), HSI space, HSV space, etc. CIELUV, 
uniform color space like CIELAB, etc. are located like Munsell color system again. 
[0012] After the image data after a color space conversion is transmitted to the image storage section 
101, in the frequency-distribution creation section 102, the frequency distribution of the color space 
corresponding to human being's consciousness are created. 

The <color space division section> In : 105 color-space division section 105, the color space 
corresponding to human being's consciousness is divided into two or more subspaces based on the result 
of the frequency-distribution creation section 102 (the division 207 of the drawin g 2 color space, and 
integrated 208 reference of subspace with few pixels). Processing of the color space division section 105 
is shown below. 

[0013] ** 1** Ask for the data range of a brightness component and a **** component from frequency 
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distribution, and determine the range of the brightness component it can be considered that is the same 
color, and a **** component (Lth, Cth). 

**2** Detect the maximum of frequency distribution, attach the same identifier to the pixel in which a 
brightness component and a **** component have the color contained in the range of Lth and Cth 
focusing on the color corresponding to the maximum, and form subspace. 

[0014] **3** When an identifier operates <2> similarly and attaches an identifier to all pixels to a non- 
set up pixel, divide into two or more subspaces with an identifier which is different in a color space. 
[0015] **4** When there are few pixels contained in one subspace, a brightness component unifies with 
near different subspace on a color space. 

Actuation of resulting [ from above-mentioned <1> ] in <4> divides a color space into two or more 
subspaces. 

[0016] The result of the color space division section 105 is transmitted to the brightness image 
generation section 106. 

The <brightness image generation section> In : 106 brightness image generation section 106, to a natural 
image and each artificial image, a brightness image is generated and a result is transmitted to the image 
storage section 101 (it is [ the assignment 204 of an intensity level, and ] quota 209 reference of an 
intensity level for every subspace for every drawing 2 pixel value). 

[0017] To the image classified into the natural image in the image classification section 103, a 
brightness image is generated by assigning an intensity level as follows to each pixel value according to 
the gradation reappearance range of output equipment (it is quota 204 reference of an intensity level for 
every drawing 2 pixel value). 

[0018] First, the pixel value on the RGB space in the coordinate (i, j) of an image is changed into the 
brightness component Y (i, j) according to a formula (1). next, maximum Ymax of a brightness 
component And the minimum value Ymin It asks and asks for output-value Y' (i, j) of brightness 
according to a formula (2) according to the gradation expression range of output equipment (here — Yl - 
- the above ~ Y2 ~ it considers as the following). 
[0019] 

Y(i, j) =scale and (Y(i, j)-Ymin) +Y1 scale =(Y2-Yl)/( Ymax- Ymin) (2) A brightness image is 

generated by assigning the same intensity level to the color contained in the color space division section 
105 in the same subspace to the image classified into the artificial image (it is quota 209 reference of an 
intensity level for every drawing 2 subspace). 

[0020] First, based on those color components or a brightness component, sequence is assigned to 
subspace to the color contained in the same subspace. Next, according to the gradation expression range 
of output equipment, the sequence assigned to each subspace is changed into an intensity level based on 
the following formulas (3). A formula (3) shows the case (the number of sequence is as large as high 
brightness) where sequence is assigned to order with low brightness. 
[0021] 

Y(i, j) =interval-Order+(Index (i, j)) Yl interval=(Y2-Yl)/(N-l) (3) The identifier of the 

subspace where, as for N, the number of partitions of a color space belongs, and, as for Index (i, j), the 
pixel value of a coordinate (i, j) belongs, and Order (k) here The sequence and Yl which were assigned 
to the subspace whose identifier is k And Y2 It considers as the maximum and the minimum value of the 
gradation expression range of output equipment, respectively. 

[0022] This invention is realizable also by performing processing based on the contents of the record 
medium concerned using the record medium which recorded processing according to the flow of the 
aforementioned processing shown especially in drawing 2 . Therefore, this invention contains the record 
medium itself [ concemed ] in the technical range of this invention. 
[0023] 

[Effect of the Invention] Conversion in a brightness image can be reaUzed without losing the 
information which an input color picture has fi*om the pixel value distribution of a color picture by 
classifying an input color picture into a natural image and an artificial image, discretizing a color space 
by dividing a color space into two or more subspaces in the case of an artificial image, and assigning an 
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intensity level according to the gradation expression range of output equipment according to this 
invention. 

[0024] Drawing 3 (b) is the result of changing into a brightness image by this invention to the same 
input image (image with which a superposition indication of the character string "the Yokosuka R&D 
center" on the backgroimd which changes from white to blue gently-sloping with red color was given) as 
drawing 3 (a). By the brightness image based on this invention, in order to assign an intensity level 
which is different in an alphabetic character field and a background region, both distinction becomes 
easy. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
dcmiages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing one example of this invention. 

[Drawing 2] It is the flow chart showing the flow of processing of the brightness image generation 

method by this invention. 

[Drawin g 3] It is drawing showing the difference in the processing result in the conventional brightness 

inverter and the brightness inverter of this invention. 

[Description of Notations] 

101: Image storage section 

102: Frequency-distribution creation section 

103: Image classification section 

104: Color space conversion section 

105: Color space division section 

106: Brightness image generation section 



[Translation done.] 
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